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The Diabetes Interleukin-2 (IL-2) trial 


Pls: Frank Waldron-Lynch, Linda Wicker, John Todd (JDRF /Wellcome 
Trust) 


Statistcian: Simon Bond (CCTU) 


e Single Doses are injected SC to each newly diagnosed participant 
e any concentrations can be delivered within the target dose range 


e A biological response expected and measured by T-regulatory cell 
concentrations 


e (max) Treg % change from baseline over 5 days (used in literature) 
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Frank Waldron-Lynch et al. Rationale and study design of the Adaptive study of IL-2 dose on regulatory T cells in type 1 


diabetes (DILT1D): a non-randomised, open label, adaptive dose finding trial BMJ open 4(6) e005559 
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Models considered 


As this study was entirely novel we had no idea of the shape of the 
dose-response curve (or whether there would be a response!). 


Model # params y = f(d,0) 
Linear 2 00 + 0, x d 
Ouadratic 3 00 + 01 * d T 05 x d? 
Emax 3 Oo + ata 
Emax4 4 00 + " zon 
Logistic 4 Oo + "m 
Cubic 4 Oo + 0ı d + 09 x d? + 03 x d? 


F Bretz, J C Pinheiro, and M Branson.Combining multiple comparisons and modeling 
techniques in dose-response studies. Biometrics, 61(3):738-48, 2005. 
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Learning phase - based on simulations 


Study started with a learning phase of 10 patients out of the potential 40 
patients 


e pairs of patients were put on the doses 0.04, 0.16, 0.6, 1 and 1.5 
(IUx109 / m?) 


Then a meeting was used to have a reality check on the design (were 
simulation parameters in the right area?) 
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Study started with a learning phase of 10 patients out of the potential 40 
patients 


e pairs of patients were put on the doses 0.04, 0.16, 0.6, 1 and 1.5 
(IUx109 / m?) 


Then a meeting was used to have a reality check on the design (were 


simulation parameters in the right area?) 


e After the learning phase the clinicians choose to target 10% and 2096 
responses 


e need to use the inverse function f^ 1(y,0) = d 
e e.g. for 20% response the dose dy.» = f !(0.2,0) = g(0.2, 0). 


Interest is in both do. and do.» and want sufficient numbers of patients 
near these doses. 
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Method for selecting the next two doses 


Theoretically recruit 2 patients at a time so after k patients 
e Estimate information given model parameters 09 
e Select two future doses d* and d** that minimise 
e Trace — Var(do.2|0%)) + Var(do.1|0%)) 
e or Determinant | Var(do.1, do.2|0 9) 
e In reality need to consider any cohort size due to recruitment 
(actually recruited up to 4 a time) 


Minimising the variance of dose is less well used but mixes patient and 
variance gains. 
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Information 


Need to calculate the observed information matrix after k patients for 
the design is defined as 
KAT La Oo 00 dE LEE 


Var(0) = o2M, (0) 


Efron and Hinkley (1978) Biometrika 65(3): 457-87. 
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The algorithm 


Using the delta method 
Vark(do.1, do.2]0) = 


ög(0.1,0) 8g(0.2,0)] 7 ög( 
| 00 * å | vando)| 


0.1,0) dg(0.2,0) 
00 * 90 | (1) 


Now need to pick (d*,d**) and recalculate the above two equations 


Var „(0|d*,d**) = 


Of (d*,0) DET(d',0) | Of(d'*,6) AFT (d'*,6) d 
00 ö0 90 00 


g2 (ue + 


e Set 6 to be 009) 
e Then plug Var; Old" o into equation (1) 


e use optimization to find doses 
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Trial set up 


Attempt to fit each non-linear model to obtain 0 


Ignore the models that do not converge 
For each model repeat the optimisation to find two doses. 
e Ignore doses that have predicted values outside the dosing range 


Assess the predicted gain in precision by using each dose for each 
model 


Repeat the steps until we have 40 patients with evaluable data 


October 23, 2014 8/31 


That was the theory.... 


A Dose Determining Committee was set up, consisting of 3 groups: 
Statisticians, Biologists and Clinicians. 


e Each group had a single vote on which dose should be taken forward 
e Had a strong DDC chair 


e A Charter was set up that laid out the procedure 
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Interim Analysis Report after learning phase 


Produced by Simon Bond using Rsweave. 
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Table of estimated target doses and model fit 


Model Target 1 Target 2 
Estimate (SE) 95% CI Estimate (SE) 95% CI Deviance AIC 
Linear 0.076 (0.216) -0.35, 0.50 | 0.641 (0.147) 0.353, 0.928 0.0540 -17.8 
Quadratic | 0.110 (0.168)  -0.22, 0.44 | 0.560 (0.217) 0.136, 0.985 0.0526 -16.1 
Emax 0.105 (0.171)  -0.23, 0.44 | 0.571 (0.234) 0.112, 1.03 0.0529 -16.0 
( 
( 


Cubic 0.197 (0.618)  -1.02, 1.41 | 0.646 (0.172) 0.309, 0.983 0.0489 -14.8 
Logistic NaN (NaN) NaN, NaN | 0.683 (0.228) 0.236, 1.13 0.0456 -15.5 
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Patient 11 recommendation 


Model Recommended Doses 


Linear 1.5 (Max) 
Quadratic 0.749 
Emax 0.622 
Cubic 0.42 
Logistic 1.5 


Emax model chosen and 0.622 dose given. A good fitting middle model 
and no desire to dose at highest (signs of site reactions at higher doses). 
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Interim Analysis Report — 11 Patients 
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Table of estimated target doses and model fit 


Model Target 1 Target 2 
Estimate (SE) 95% CI Estimate (SE) 95% CI Deviance AIC 
Linear 0.022 (0.226) -0.42, 0.47 | 0.591 (0.144) 0.309, 0.873 0.0624 -19.7 
Quadratic 0.16 (0.129) -0.09, 0.41 | 0.486 (0.158) 0.177, 0.795 0.0577 -18.5 
Emax 0.095 (0.128)  -0.16, 0.35 | 0.479 (0.201) 0.085, 0.874 0.0583 -18.4 
Logistic NaN (NaN) NaN, NaN 0.607 (0.01) 0.588, 0.625 0.0456 -19.1 
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Model | Recommended Doses | Decrease in CR area (90) 
Linear Quadratic Emax 
Linear 1.5 1.5 22.6 1.2 1.5 
Guadratic | 0.16 0.753 11.6 16.8 14.9 
Emak 0.485 0.485 8.8 13.9 17.9 
Logistic NA NA - - - 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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Interim Analyses 
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FINAL — Table of estimated target doses and model fit 


Model Target 1 Target 2 
Estimate (SE) 95% CI Estimate (SE) 95% Cl Deviance AIC 
Linear 0.043 (0.10) -0.16, 0.25 | 0.557 (0.080) 0.400, 0.714 0.290 -71.4 
Quadratic | 0.094 (0.067) -0.04, 0.22 | 0.471 (0.085) 0.305, 0.636 0.276 -71.3 
Emax 0.091 (0.058)  -0.02, 0.20 | 0.463 (0.100) 0.266, 0.659 0.277 -71.2 
Cubic 0.094 (0.069) -0.04, 0.23 | 0.472 (0.101) 0.275, 0.670 0.276 -69.3 
Logistic 0.094 (0.070) -0.04, 0.23 | 0.468 (0.103) 0.266, 0.670 0.277 -69.2 
Emax4 0.086 (0.074) -0.06, 0.23 | 0.461 (0.107) 0.252, 0.670 0.277 -69.2 
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Model Recommended Doses Decrease in CR Area (Yo) 
Linear Quadratic Emax Cubic Logistic  Emax4 

Linear 1.5 1.5 18.0 1.2 1.3 0.0 0.7 1.0 
Quadratic | 0.045 0.719 4.7 6.4 5.5 4.4 5.0 3.9 

Emax 0.045 0.433 3.9 5.6 6.6 7.3 6.6 5.0 

Cubic 0.045 0.380 3.9 5.3 6.5 7.4 6.7 5.5 

Logistic 0.045 0.380 3.9 5.3 6.5 7.4 6.7 5.5 

Emax4 0.154 0.154 3.9 4.0 4.0 4.6 4.6 10.5 
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Model Doses Selected Models Converged 


Start (Patient 11) Emak Li, Q, E, C, Lo 
Emax (top dose) Li, Q, E, C, Lo 
Quadratic Li, Q, E, Lo 
Emax Li, Q, E, C, Lo 
Quadratic Li, O, E 
Ouadratic Li, Q, E 
Ouadratic Li QE 
Emax Li, O, E 
Logistic Li, Q, E, C, Lo 
Logistic Li, Q, E, C, Lo, E4 
Logistic Li, Q, E, C, Lo, B 
Quadratic Li, Q, E, €,- Lo 
Emax4 Li, Q, E, C, Lo, E4 
Cubic Li, Q,'E, € 
Cubic Li, Q, E, € 
Quadratic/Emax/Cubic Li, Q, E, € 
Cubic Li, Q, E, C 
Emax Li, Q, E, C, Lo, E4 
End (Patient 39) Cubic Li, Q, E, C, Lo, E4 


Li = Linear O = Qudratic, E = Emax, C = Cubic,Lo = Logisitic, E4 = Emax4 and B = Bespoke 


e Surprisingly good convergence! 
e Great residuals and other diagnostic checks. 


e An emerging trend towards cubic from quadratic /Emax 
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Lessons to be learnt 


e The methods were very flexible. 


e Doses were selected based on the model fit BUT also on the desire to 
experiment as scientists. 


e There was pressure NOT to dose the smallest dose all the time! 


e There were other data other lab measurements that might also 
suggest other doses 


e An upper limit really came into effect due to injection reaction sites 
( 0.7 upwards) 


e An outlier at patient 38? 
e three-way discussions very informative. 
e Problems with the maximum Treg value when low dose. 


e The lowest dose changed due to pharmacy problems 
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Outlier 
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This person was a protocol violator as they had an infection 


Model-robust method 


Emma McCallum (PhD student) 
Create model weights based on goodness of fit 


2K(K +1) 
AIC, = AIC + — -- — 
ui n-- K--1 
where n is sample size and K is number of parameters 
A(AIC,,) = AIC; - min( AIC) 


AIC. is the AIC. for model i and min() term is the smallest A/C. for any 
model 


Define weights as (re-estimated at each interim) 
exp(—0.5AAIC;) 
W; — 


3 exp(-0.5AAIC.,) 
i-1 
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Model robust extension to optimality criteria 


i is the model index and k is the last fully observed patient and want to 
find (d*, d**) that minimises 


Kë w; Varı +2.:(do.1, do.2|6%)) 
isl 


Vark+2,i(do.1, do. 2/0) = 
ka ögı(0.2, d) 


Vario (OM a", d**) 


00 i 00 00 i 00 


Og;(0.1, 02) MI 
Vario (8%? d*, d**) = 


A(k,i A(k,i xx A(k,i xx A(k,i =l 
E iv. (ate) | Of (d*, ge) 8f; (d*, ge) | Ofi(d Ok )) Of (d Ge )) 
ki e 00 00 00 00 
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Example simulation 
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"True" model fitted to IL-2 data 


Quadratic model had lowest A/C, 


Quadratic model fitted to real IL2 data 


o 


0.0 0.5 1.0 1.5 


d 
b1=-9.230, b2=31.588, b3-6.560, res.se=8.888 
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One simulation for model-robust sequential IL-2 study 
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Variance improvement 


Trace of variance-covariance matrix in IL-2 was 0.00327 and the histogram 
of values obtained by simulation is below 


Frequency 


EP nena 
0.0020 0.0025 00030 00035 


Variance of 2 target doses 
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Conclusions 


Described two methods to handle two targets and multiple models 


Always have a polynomial in the model set 


Model robust methods work well in simulations 


A three-way vote in the dose determining committee with a 
supportive clinician is the way to go 


Recruitment has started for a repeat dosing study, with a multivariate 
outcome to determine the best dose/dosing interval 
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